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ASYMMETRIC EVOLUTIONARY GAMES 


ALEX MCAVOY AND CHRISTOPH HAUERT 


Abstract. Evolutionary game theory is a powerful framework for studying evolution in populations of in¬ 
teracting individuals. A common assumption in evolutionary game theory is that interactions are symmetric, 
which means that the players are distinguished by only their strategies. In nature, however, the microscopic 
interactions between players are nearly always asymmetric due to environmental effects, differing baseline 
characteristics, and other possible sources of heterogeneity. To model these phenomena, we introduce into 
evolutionary game theory two broad classes of asymmetric interactions: ecological and genotypic. Ecolog¬ 
ical asymmetry results from variation in the environments of the players, while genotypic asymmetry is a 
consequence of the players having differing baseline genotypes. We develop a theory of these forms of asym¬ 
metry for games in structured populations and use the classical social dilemmas, the Prisoner’s Dilemma and 
the Snowdrift Game, for illustrations. Interestingly, asymmetric games reveal essential differences between 
models of genetic evolution based on reproduction and models of cultural evolution based on imitation that 
are not apparent in symmetric games. 


1. Introduction 


Evoluti onary game theory has been used e xtensivelY to study the eyolution of cooperation in social 
dilemmas ( Ohtsnki et al. . 200fit Nowakl l2006at I Taylor et all 12007 1. A social dilemma is typically modeled 


as a game with two strategies, cooperate (C) and defect (D), whose payoffs for pairwise interactions are 
defined by a matrix of the form 


( 1 ) 


c 

D 

R, R 

S,T 

T,S 

P,P 


(jMaynard Smithl . Il982t iHofbauer and Sigmundl . Il998f) . For a focal player using a strategy on the left-hand 
side of this matrix against an opponent using a strategy on the top of the matrix, the first (resp. second) 
coordinate of the corresponding entry of this matrix is the payoff to the focal player (resp. opponent). That 
is, a cooperator receiyes R when facing another cooperator and S when facing a defector; a defector receiyes 
T when facing a cooperator and P when facing another defector. Since the same argument applies to the 
opponent, the game defined by o is symmetric. If defection pays more than cooperation when the opponent 
is a cooperator {T > R), but the payoff for mutual cooperation is gr eater than the payoff for mutual defection 


IS a cooperator [1 > K ), Put tne payoti tor mutual cooperation is gr eater tnan tne payoti tor mutual detection 
{R> P), then a social dilemma (iDawesl 19801 : iHauert et ah . 2006ll arises from this game due to the conflict 
of interest between the indiyidual and the group (or pair). The nature of this social dilemma depends on the 
ordering of R, S, T, and P. Biologically, the most important r ankings are given by th e Prisoner’s Dilemma 
(T > R > P > S) and the Snowdrift Game (T > R > S > P) (iMaynard Smith . 19821 : Hauert and Doebeli . 
I 2 OO 4 I : IPoebeli and Han^ , 1200,4 iHanert et al. , 2004 Voelkl l20ir)ll . 

Since matrix m defines a symmetric game, any two players using the same strategy are indistinguish¬ 
able for the purpose of calculating payoffs. In nature, h oweyer, asymmet r y freq uently arises in interspecies 
interactions such as parasitic or symbiotic relationships ( Maynard Smith . 1982h. Interactions between sub¬ 
populations, such as in Dawkins’ Battle of the Sexes Game ( Dawkins! .' 19761 : Schuster and Sigmund , 1981 


IMaynard Smith and Hofbauerj . Il987l : iHofbaueil . 1996ll , also giye rise to asymmetry that cannot be modeled 
by the symmetric matrix m- Eyen intraspecies interactions are essentially always asymmetric: (i) pheno¬ 
typic yariations such as size, strength, speed, wealth, or intellectual capabilities; (ii) differences in access to 
and ayailability of enyironmental resources; or (iii) each indiyidual’s history of past interactions, all affect the 
interacting indiyiduals differently and result in asymmetric payoffs. The winner-loser effect, for example, is a 
well-studied example of effects of previou s encounters on future inte ractions and has been reported across tax a 
(Dugatkin, 1997HMavnard SmitlJ . Il982h . including even mollusks ( Wrig-ht and Shanl^ . 199,31: l^anksL I 2 OO 2 I 1 . 
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Asym metry may also result from the assignment of social roles (ISelten , 19801 : Hammerstein , 1981 ; Ohtsuki , 
2010ll . such as the roles of “parent” and “offspring” ( Marshall . 12009 1: cooperation may be tied to individual 
energy or strength, for example, which is, in turn, determined by a player’s role. In the realm of continuous 
strategies, adaptive dynamics has be en used to study asymmetric competition, which applies to the resource 
consu mption of plants, for instance ( Weiner . 1990l : Freckleton and Watkinson . 2001 : Doebeli and Ispolatov . 
20121) . In social dilemmas containing many cooperators, accumulated benefi ts may be synergist ically en¬ 
hanced (or discounted) in a way that depends on who or where the players are ( Hauert et al.l . l2006l) . thereby 


making larger group interactions asymmetric. To model such interactions using evolutionary game theory, 
the payoff matrix must reflect the asymmetry. 

In the Donation Game, a cooperator pays a cost, c, to de liver a benefit, 6, to the opponent, while a 
defector pays no cost and provides no benefit ( Sigmund . 201Cll) . In terms of matrix ([T|), this game satisfies 
R — b — c, S = —c, T — b, and P — 0. Provided b and c are positive, mutual defection is the only Nash 
equilibrium. If 6 > c, then this game defines a Prisoner’s Dilemma. Perhaps the simplest way to modify 
this game to account for possible sources of asymmetry is to allow for each pair of players to have a distinct 
payoff matrix; that is, the payoff matrix for player i against player j in the Donation Game is 

C D 




C 


bj - Ci 


D 



( 2 ) 


- c, 

for some bi, bj, Ci, and Cj. If player i cooperates, then this player donates bi to his or her opponent and 
incurs a cost of Ci for doing so. As before, defectors provide no benefit and pay no cost. The index i could 
refer to a baseline trai t of the player, the player’s location, his or her history of past interactions, motivation 
( Bergman et ah . 2010[l . or any other non-strategy characteristic that distinguishes one player from another. 

Games based on matrices of the form with payoffs for both players in each entry of the matrix, are 
sometimes call ed bimatr i x games. Although bimatrix games have appeared in the context of evolution¬ 
ary dynamics ( Hofbauer . 1996t Hofbauer and Sigmundl . 12003 : OhtsukiL l2010l) ^ most of the focus on these 


games has been in the setting of classical game theory and economics (see iFudenberg and Tirolel Il991 ) 
where “matrix game” generally means “bimatrix game.” Bimatrix games may be used to model classical 
asymmetric interactions such as those arising from sexual asymmetry in the Bat tle of the Sexes Game 
( Magurran and Nowakl [l99lh . The asymmetric, four-strategy Hawk-Dove Game of ( Mavnard Smithl . Il982l) 
consisting of the st rategies Hawk, Dove, Bou rgeois, and anti-Bourgeois may also be framed as a (4 x 4) 
bimatrix game Isee iMesterton-Gibbonsl. 19921). Svmmetric matrix games, such as o, are special cases of 
bimatrix games. We explore here the ways in which bimatrix games can be incorporated into evolutionary 
dynamics and used to model natural asymmetries in biological populations. 

We treat two particular forms of asymmetry: ecological and genotypic. Ecological asymmetry is derived 
from the locations of the players, whereas genotypic asymmetry is based on the players themselves. With 
ecological asymmetry, is the payoff matrix for a player at location i against a player at location j. Since 
the payoffs depend on the locations of the players, this form of asymmetry requires a structured population. 
Ecological asymmetry is a natural consideration in evolutionary dynamics since it ties strategy success to 
the environment. In the Donation Game, for instance, cooperators might be donating goods or services, but 
the costs and benefits may depend on the environmental conditions, i.e. the location of the donor. 

On the other hand, players might instead differ in ability or strength, and “strong” cooperators might 
contribute greater benefits (or incur lower costs) than “weak” cooperators. This variation results in genotypic 
asymmetry, where each player has a baseline genotype (strength) and a strategy (C or D). This form of 
asymmetry turns out to be subtler than it seems a t first glance, however, since genotype s are generally 
represented by strategies in evolutionary game theory ( Mavnard Smith . 1982t Dugatkiii| . l2000l) . In particular, 
it might seem that the genotype and strategy of a player could be combined into a single composite strategy 
and that the symmetric game based on these composite strategies could replace the original asymmetric 
game. As it happens, whether genotypic asymmetry can be resolved by a symmetric game depends on the 
details of the evolutionary process. 

Gl assically, evolutionary games were studied in infinite populations via replicator dyna mics (iTavlo r and J onker 
1978 ), and more r ecently these games have been considered in finite populations ( Nowak et al.l . |2004 
Tavlor et al. . 20041 ). Because every biological population is finite, we focus on finite populations (which. 
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for technical reasons, we assume to be large). Since ecological asymmetry requires distinguishing different 
locations within the population, we assume that the population is structured and that a network defines the 
structure. Network-structured populations have received a considerable amount of attention in evolution¬ 


ary game theory and provide a natural setting i n which to study social dilemmas (ILieberman et al.l, 12005 


Ohtsuki et al.l. 20061 : Ohtsuki and Now^ 2006t Tavlor et al.l . 12007 : Szabo and Fathl . 2007 : Debarre et al 


20141) . Compared to well-mixed populations, in which each player interacts with every other player, networks 
can restrict the interactions that occur within the population by specifying which players are “neighbors,” 
i.e. share a link. We represent the links among the N players in the population using an adjacency matrix, 
which is defined by letting Wij = 1 if there is a link from vertex i to vertex j and 0 otherwise 
(and satisfies Wij = Wji for each i and j). 

In an evolutionary game, the state of a population of players is defined by specifying the strategy of each 
player. Each player interacts with all of his or her neighbors. The total payoff to a player is multiplied by 
a selection intensity, /3 ^ 0, and then converted into fitness (see Methods). Once each pla yer is assigned a 
fitness, an update rule is used to determine the state of the population at the next time step ( Nowakl . 2006bll . 
For example, with a birth-death update rule, a player is chosen from the population for reproduction with 
probability proportional to relative fitness. A neighbor of the reproducing player is then randomly chosen 
for death, and the offspring, who inherits the s trategy of the parent, fills the vacancy. This process is a 
modification of the Moran process ( Moran . 19581) . adapted to allow for (i) frequency-dependent fitnesses and 
(ii) population structures that are not nec essarily well-m i xed. The order of birth and death could also be 
reversed to get a death-birth update rule ( Ohtsuki et al.l . 20061) . In this rule, death occurs at random and 
the neighbors of the deceased compete to reproduce in order to fill the vacancy. These two rules result in 
the update of a single strategy in each time step, but one could consid er other rules, such as W right-Fisher 
updating, in which all of the strategies are revised in each generation ( Imhof and Nowak . 200^. The rules 
mentioned to this point define strategy updates via reproduction and inheritance; as such, we refer to them 
as genetic update rules. 

Another popular class of update rules is based on revisions to the existing players’ strategy choices. 
We refer to rules falling into this class as cultural update rules. Examples include imitation updating, in 
which a player is selected at random to e valuate his or her str ategy and then probabilistically compares this 
strategy to those of his or her neighbors ( Ohtsuki et al.L 2006 ). A more localized version of this update rule 
is known as pairwise comparison updating, in which a player chooses a random neighbor fo r comparison 


rather than looking at the entire neighborhood ( Szabo and Tdkel 1998 : Traulsen et ah . 20071) . Under best 


response dynami cs, an individu al adopts the strategy that performs best given the current strategies of his 
or her neighbors ( Ellison . 1 19931) . In each of these cultural processes, the strategy of a player can change, but 
the underlying genotype is always the same, which suggests that baseline genotype and strategy need to be 
treated separately. 

Genotypic asymmetry needs to be handled more carefully if the update rule is genetic since the nature of 
genotype transmission affects the dynamics of the process. In contrast to cultural processes, the genotype 
and strategy of a player at a given location may both change if the update rule is genetic: genotype may 
be inherited but not imitated. We will see that this property results in cultural and genetic processes 
behaving completely differently i n the presence of genotypic asymmetry. Ph enotype may have both genetic 
and environmental components ( Mahner and Kamll997l : Bave et ah . 201ll) . and after treating the genetic 
(genotypic) and environmental components separately, these two forms of asymmetry may be combined in 
order to get a model in which the asymmetry is derived from varying baseline phenotypes. Thus, with 
a theory of both ecological asymmetry and genotypic asymmetry based on inherited genotypes, one can 
account for more complicated forms of asymmetry appearing in biological populations. 


2. Results 

2.1. Ecological asymmetry. Here we develop a framework for ecologically asymmetric games in which the 
payoffs depend on the locations of the players as well as their strategies. We assume that all of the players 
have the same set of strategies (or “actions”) available to them, {Ai ,..., A„}. The payoff matrix for a player 
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at vertex i against a player at vertex j is 
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That is, a player at vertex i using strategy Ar against an opponent at vertex j using strategy As realizes a 
payoff of apg, whereas his opponent receives qA.. Since depends on i and j, these payoff matrices capture 
the asymmetry of the game. 

In the simpler setting of symmetric games, the pair approximat ion method has been used successfully 
to describe the dynamics of evo l utionary processes on networks ( Matsuda et al. 1, I 1992 I: iBollobasl 120011: 
Ohtsuki et al.l . 20061 : IVukov et ah . 2006 : Ohtsuki and Now^ 2006ll . For each r € n}, this method 


approximates the frequency of strategy Ar , which we denote by Pr , using the frequencies of strate gy pairs in 
the population. Pair appro ximation is expected to be accurate on large random regular networks (IBollobas . 
2001 : Ohtsuki et al.L I 2 OO 6 II . so we assume that the network is regular (of degree k > 2) and that N is suf¬ 
ficiently large. (For fc = 2, the network is just a cycle, which we do not treat here.) We also take /3 <C 1, 
meaning that selection is weak, which results in a separation of timescales: the local configurations equi¬ 
librate quickly, while the global strategy frequencies change much more slowly. This separation allows us 
to get an explicit expression for the expected change, E [Ap^], in the frequency of strategy Ar for each r. 
Incidentally, weak selection happens to be quite reasonable from a bi ological pe r spect i ve since each trait is 
expected to have only a small effect on the overall fitness of a player ( Wu et al.l . I 2 OIC 1 I : Tarnita et al. , 2011 ; 
IWu et al.l.[20ll . 

Interestingly, for two genetic and two cultural update rules, weak selection reduces ecological asymmetry 
to a symmetric game derived from the spatial average of the payoff matrices: 

Theorem 1. In the limit of weak selection, the dynamics of the ecologically asymmetric death-birth, birth- 
death, imitation, and pairwise comparison processes on a large, regular network may be approximated by 
the dynamics of a symmetric game with the same update rule and payoff matrix M := ^ 

i.e. 


(4) 
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where Ust ■= for each s and t. 

For a proof of Theorem [1] see Methods. In Methods, we derive explicit formulas for E [Ap^] for each r 
(where Pr is the frequency of strategy Ar and E [Ap,.] is the expected change in pr in one step of the process) 
and show that these expectations depend on M in the limit of weak selection. If we choose an appropriate 
time scale and make the approximation 


Pr ■■= 


dpr 

dt 


E [Apr 
At 


(5) 


then the dynamics of a n ecologically asymmetric p rocess may also be described in terms of the replicator 
equation (on graphs) of Ohtsuki and Nowak ( 2006h : If (j) '■= ff^en 


Pr = Pr 



+ ^rs) ~ ' 


( 6 ) 
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where brs is a function of M, k, and the update rule. (For each of the four processes, the explicit expression 
for brs is provided in Methods.) The matrix (brs)^ accounts for local competition resulting from the 


population structure Isee lOhtsuki and Nowak . 2006ll . In particular, the Ohtsuki-Nowak transform. 


(Oj.s)r.,s=l ^ (ors + ^rs) ^ j 


(7) 


which transforms the classical replicator equation into the replicator equation on graphs, also applies to 
evolutionary games with ecological asymmetry. 

Even though interactions are now governed by a symmetric game. Theorem [1] states that, in general, 
the dynamics depend on the particular network configuration, that is, the symmetric payoffs 

defined by M still depend on the network structure, or, equivalently, on the distribution of ecological resources 
within the population. However, somewhat surprisingly, there is a broad class of games for which this 
dependence vanishes: 

Definition 1. If a*-), = + ylg for each r and s, then M*-! is called a spatially additive payoff matrix. If 

is spatially additive for each i and j, then the game is said to be spatially additive. 

A game is spatially additive if the payoff for an interaction between any two members of the population can 
be decomposed as a sum of two components, one from ea ch player’s location. Note t hat spatial additivity is 
different from the “equal gains from switching” property ( Nowak and Sigmund . 1990ll in that neither implies 
the other. However, spatial additivity is an analogue in the following sense: if two players at different 
locations use the same strategy against a common opponent, then the difference in these two players’ payoffs 
for this interaction is independent of the location of the opponent. Interchanging “location” and “strategy,” 
one obtains the equal gains from switching property. The importance of spatially additive games is due to 
the following corollary to Theorem [1] 

Corollary 1. If is spatially additive for each i and j, then the expected change in the frequency of 
strategy Ar, E[Apj.], is independent of j<jv each r. In particular, the dynamics of the process 

do not depend on the particular network configuration. 

As an example, the asymmetric Donation Game is spatially additive and possesses the equal gains from 
switching property, which greatly simplifies the analysis of its dynamics: 

Example 1 (Donation Game with ecological asymmetry). The asymmetric Donation Game with payoff 
matrices defined by Eq. @ is spatially additive and satisfies 


C 


D 


D 


b — c, b — c —c, b 
b, —c 0, 0 


( 8 ) 


where b = ^ Therefore, the dynamics of the asymmetric game are the same 

as those of its symmetric counterpart with benefit, b, and cost, c, regardless of network configuration or 
resource distribution. Under death-birth (resp. imitation) updating, this result implies that cooperation 
is expect ed to increase if and only if b/c > k (resp. b/c > k + 2), where k is the degree of the (regular) 
network ( Ohtsuki et al.l . BoOGII . Fig.[IjA) compares the predicted result obtained from M to simulation data 


for imitation updating when benefit and cost values are distributed according to Gaussian random variables. 

Example 2 (Snowdrift Game with ecologic al asymmetry). In order to illustrate when Goro l laryfJ fails, we 
turn to cooperation in the Snowdrift Game ( Hauert and Doebeli . 2004 : Doebeli and Hauer^ . I 2 OO 5 I 1 . In this 
game, two drivers find themselves on either side of a snowdrift. If both cooperate in clearing the snowdrift, 
they share the cost, c, equally, and both receive the benefit of being able to pass, b. If one player cooperates 
and the other defects, both players receive b but the cooperator pays the full cost, c. If both players defect, 
each receives no benefit and pays no cost. In order to incorporate ecological asymmetry, we assume that the 
benefits are all the same since they are derived from being able to pass in the absence of a snowdrift. On the 
other hand, the cost a player pays to clear the snowdrift may depend on his or her location: the snowdrift 
may appear on an incline, for example, in which case one player shovels with the gradient and the other 


5 






























player against it. Moreover, when two cooperators meet, they might clear unequal shares of the snowdrift. 
Thus, the payoff matrix for a player at location i against a player at location j should be of the form 


(a,,) := 


C 

C' ( b (y.'ijC'iij b (Xj-iCj 

D\ b, b-Cj 



(9) 


where 0 ^ aij ^ 1 and aij + aji = 1 ( Du et ah . 2009l l. Intuitively, when two cooperators face one other, 
they each begin to clear the snowdrift and stop once they meet; the quantity aij indicates the fraction of 
the snowdrift a cooperator at location i clears before meeting the cooperator at location j. A natural choice 
for an is 


aij 



( 10 ) 


which is the unique value that gives aijCi = ajiCj for each i and j, ensuring that the game is fair, i.e. that 
the cooperator with the higher cost clears a smaller portion of the snowdrift than the one with the lower 
cost. Averaging the payoff to one cooperator against another over all possible locations gives 
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N 




(b aijcfj 


= b- 
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Wi 


CiCj 
Ci + Cj 


( 11 ) 


which is the upper-left entry of M. In contrast, the remaining three entries of M do not depend on 
{wij)i<i j<N- Therefore, provided there are at least two locations with distinct cost values, the dynam¬ 
ics of an evolutionary process depend on the particular network configuration (Theorem [IJ. This network 
dependence is illustrated in Fig. [2j 

Suppose now that we set aij = 1/2 to model ecological asymmetry in the Snowdrift Game; that is, if 
two cooperators meet, they each clear exactly half of the snowdrift. If there are two cost values in the 
population, ci and C2, with ci < b < C2 < 2 b, then a player who incurs a cost of ci finds it beneficial to 
cooperate against a defector, but a player who incurs a cost of C 2 would rather defect in this situation. 
Thus, based on the social dilemma implied by the ranking of the payoffs, a player who incurs a cost of ci 
for cooperating is always playing a Snowdrift Game while a player who incurs a cost of C 2 is always playing 
a Prisoner’s Dilemma. It follows that ecological asymmetry can account for multiple social dilemmas being 
played within a single population, even if the players all use the same set of strategies (C and D). The payoff 
matrices of this particular game are spatially additive, so, by Gorollary[Tl the dynamics do not depend on 
the network configuration. If q is the fraction of vertices with cost value ci then c = qci + {1 — q) C 2 is the 
average cost of cooperation for a particular location and the dynamics are the same as those of the symmetric 
Snowdrift Game in which the cost of clearing a snowdrift is c (see Fig.[I](B)). Fig. [3] demonstrates that this 
result does not extend to stronger selection strengths, so Theorem [T] is unique to weak selection. 

Based on Theorem [T] and the relative rank of payoffs, the social dilemma defined by the asymmetric 
game ([HI) (for general aij) is a Prisoner’s Dilemma if 6 < c and a Snowdrift Game if 6 > c when selection 
is weak. That is, microscopically, there is a mixture of Prisoner’s Dilemmas and Snowdrift Games, but, 
macroscopically, the process behaves like just one of these social dilemmas. Consequently, although the 
dynamics of this evolutionary process may depend on the network configuration, the type of social dilemma 
implied by this game does not. 


2.2. Genotypic asymmetry. Another form of asymmetry is based on the genotypes of the players rather 
than their locations. Each player in the population has one of i possible genotypes, and these genotypes are 
enumerated by the set {1,... ,€\. For an n-strategy game, the payoff matrix for a player whose genotype is 
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Figure 1. Average change in the frequency of cooperators, Apc, as a function of the 
frequency of cooperators, pc, in (A) an asymmetric Donation Game and (B) asymmetric 
Snowdrift Games. The update rules are (A) imitation and (B) death-birth, and each process 
has for a selection intensity /3 = 0.01. In both figures, the network is a random regular graph 
of size N = 500 and degree k = 3. In (A), benefits and costs of cooperation vary across 
vertices according to a Gaussian distribution with mean 3.5, variance I.O for benefits and 
mean 0.5, variance 0.25 for costs. In (B), the benefit is 5 = 5.0 for all vertices, and the costs 
are either low, ci = 34/13, or high C2 = 70/13, which actually recovers the payoff ranking 
of the Prisoner’s Dilemma because C2 > b. The costs are the same for all vertices (ci, blue 
and C2, green) or mixed at equal proportions (red). (B) confirms that the average change 
in cooperators in the mixed Snowdrift Game/Prisoner’s Dilemma (red) may be obtained by 
averaging these changes for the Snowdrift Game (blue) and the Prisoner’s Dilemma (green). 
The small, systematic deviations between simulation data and analytical predictions (solid 
lines) are explained in Methods (where it is also shown that Apc is linear in /3 for /3 -C 1). 
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We explore genotypic asymmetry for cultural and genetic processes separately: 


( 12 ) 


2.2.1. Cultural updating. If genotypic asymmetry is incorporated into a cultural process, then the genotypes 
of the players never change; only the strategies of the players are updated. In a structured population, it 
follows that each player’s genotype may be associated with his or her location, and this association is an 
invariant of the process. Thus, if u {i) denotes the genotype of the player at location i, then we may apply 
Theorem [T] to the matrices defined by M'-l = for each i and j. In this sense, genotypic asymmetry 

may be “reduced” to ecological asymmetry in evolutionary games with cultural update rules. Note that, 
unlike ecological asymmetry, genotypic asymmetry does not require a structured population. However, one 
can always think of a population as structured (even in the well-mixed case), and doing so allows one to 
make sense of the “locations” of the players and to apply Theorem [T] to cultural processes with genotypic 
asymmetry. 
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Figure 2. Average change in the frequency of cooperators, Apc: as a function of the 
frequency of cooperators, pc, for a spatially non-additive Snowdrift Game, Eq. (0, with 
selection intensity (3 = 0.01. The blue and green data are obtained using pairwise comparison 
updating and differ only in the configuration of the underlying network, which in both cases 
is a random regular graph of size N = 500 and degree fc = 3. Every vertex has a benefit value 
of 6 = 4.0, and the cost values are split equally, with half of the vertices having ci = 0.5 and 
the remaining half having C2 = 5.5. The average payoff for mutual cooperation, Eq. (EH), 
is 3.069 (blue) and 2.961 (green), which suggests that the former arrangement is more 
attractive for cooperation. The analytical predictions (solid lines) are obtained from Eq. 
((48l) in Methods (and are linear in /3 for ,5 <§: 1). 




PC PC 

Eigure 3. The Snowdrift Games of Fig. [TJB) with the stronger selection strengths /3 = 0.1 
(A) and /3 = 0.5 (B). For each of the three games (with benefit b = 5.0 and costs ci, C 2 , 
and half ci/half C 2 , respectively), the simulation results differ from the prediction of pair 
approximation already for /3 = 0.1 (A). Moreover, for /3 = 0.5, (B) makes it clear that 
Theorem [T] no longer holds since the average change in cooperators in the game with mixed 
costs (red) differs from the average (grey) of these changes for the games with costs ci only 
(blue) and C 2 only (green). Thus, Theorem [T] is peculiar to weak selection. 
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Example 3 (Donation Game with genotypic asymmetry and cultural updating). In the Donation Game, 
a cooperator of genotype u donates bu at a cost of Cu- Defectors contribute no beneht and pay no cost, 
irrespective of genotype. Gonsider imitation updating on a large, regular network of degree k, and let u (i) 
denote the genotype of the player at location i (henceforth “player i”). Suppose that player i is a cooperator, 
player j is a defector, and that player i imitates player j and becomes a cooperator. Despite this strategy 
change, the genotype of player i is still u{i), and the payoff matrix for player i against player j is still 
M“(*)“(^). On the other hand, consider the same process but with the genotypic asymmetry replaced by 
ecological asymmetry (and with := as the payoff matrix for the player at location i against the 

player at location j). Since the genotype of a player at a given location never changes in an imitation process, 
the process with ecological asymmetry is well-defined; that is, M'-f is independent of the dynamics of the 
process for each i and j. Therefore, we may instead study the evolution of cooperation in the process with 
ecological asymmetry, and we already know from Example [T] that, in the limit of weak selection, the frequency 
of cooperators in this Donation Game is expected to increase if and only if (fc -|- 2) ^u{i) < Sti 

In contrast, for genetic update rules, the asymmetry present due to differing genotypes can be removed 
completely if the genotypes of offspring are determined by genetic inheritance: 

2.2.2. Genetic updating. Genetic update rules are defined by the ability of players to propagate their offspring 
to other locations in the population by means of births and deaths. In other words, there is a reproductive 
step in which genetic information is passed from parent (s) to child. Both the death-birth and birth-death 
processes have genetic update rules, but reproduction need not be clonal for the update rule to be genetic. 
If the genotypes of offspring are determined by genetic inheritance, then the strategy and genotype at each 
location are updated simultaneously: if the offspring of a player whose genotype is u and whose strategy is 
Ar replaces a player whose genotype is v and whose strategy is , then v is updated to u and As is updated 
to Ar synchronously. Therefore, rather than treating genotypes and strategies separately, we may consider 
them together in the form of pairs, {u,Ar), linking genotype and strategy. These pairs may be thought of 
as composite strategies of a larger evolutionary game whose payoff matrix, M, is defined by 

:= o™ (13) 

for genotypes, u and u, and strategies, Ar and Ag. The map 

|m™|^ —(14) 

resolves a collection of n x n asymmetric payoff matrices with a single symmetric payoff matrix, M, of 
size x In. This argument holds for any population structure, so evolutionary processes with genotypic 
asymmetry that are based on genetic update rules can be studied in any setting in which there is a theory of 
symmetric games. For example, we may use the results from pair approximation on large, regular networks 
to study the Donation Game with genotypic asymmetry and genetic updating: 

Example 4 (Donation Game with genotypic asymmetry and genetic updating). As in Example [3l a coop¬ 
erator of genotype u in the Donation Game donates at a cost of c„. Defectors contribute no benefit and 
pay no cost, irrespective of genotype. For the death-birth and birth-death update rules, defectors may be 
modeled as cooperators whose benefit and costs are both 0. In the larger symmetric game dehned by Cl, 
it follows that there are 1 distinct composite strategies: (1, C), (2, C), ..., (£, C), and D := {^ + 1, C). 
For death-birth updating on a large, regular network of degree k, cooperators of genotype u S {1,..., £} are 
expected to increase if and only if 

/ ^ \ ^ 

k I Cu ^ ^ CvPv I ^ bu ^ ^ buPu.j (1^) 

where, for each u G {1 ,... ,£}, denotes the frequency of cooperators of genotype v (i.e. the frequency of 
strategy (u, C) in the larger symmetric game). The terms X]u=i ^vPv and ^vPv are the average popu¬ 

lation benefit and cost values, respectively. Therefore, the condition for the expected increase in cooperators 
of a particular genotype depends on the average level of cooperation within the population. Eq. (m may 
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be thought of as an analogue of the ‘6/c > fc’ rule of Ohtsuki et al. ( 2006ll with b replaced by the “benefit 
premium,” bu — ^vPv, and c replaced by the “cost premium,” Cu — ^vPv 

In the birth-death process, on the other hand, cooperators of genotype u G {1,... ,£} are expected to 
increase if and only if 

i 


Cu ^ ^ ^ CuPv 


(16) 


Interestingly, this condition is independent of the benefit values and says that cooperators of genotype 
u G increase in abundance if they incur, on average, smaller costs for cooperating than the other 

cooperators. 

Eqs. (fTSl) and (fT6)) are obtained by noticing that the expected change in the frequency of cooperators of 
genotype u, E [Ap^], is a positive multiple of — X)«=i ^vPv — k ^Cu — X)«=i (^yPuJ in the death-birth process 

and of c-uPj; — c„ in the birth-death process (see Eqs. (1551) and (1551) in Methods). In the birth-death 
process, it follows that the expected change in the frequency of cooperators of genotype u is close to 0 if p„ 
is close to 1, hence increases in cooperators who pay nonzero costs are necessarily transient. 

3. Discussion 

Asymmetric games naturally separate standard evolutionary update rules into cultural and genetic classes. 
This distinction is important because it captures biological differences that are not always apparent in models 
of evolution based on symmetric games. For example, consider a model player whose offspring replaces a 
focal player and a model player whose strategy is imitated by a focal player. For symmetric games, processes 
based on these two types of updates are mathematically identical; if asymmetry is present, then the fact 
that one update is genetic (replacement) and the other is cultural (imitation) becomes important. Thus, 
asymmetric games can highlight fundamental differences in evolutionary processes that are based on distinct 
update rules but happen to behave similarly when the underlying game is symmetric. 

In order to incorporate into evolutionary games the asymmetries commonly studied in classical game the¬ 
ory, our focus has been on games with asymmetric payoffs. Games with asymmetric payoffs arise naturally 
from different forms of interaction heterogeneity. De pendence of payoffs on the en vironment is a reason¬ 
able assumption when considering ecological variation ( Macieiewski and Puleol 2014 ). Certain patches may 
provide resources or have drawbacks that influence a player’s success when using a particular strategy 
( Kun and DieckmannI. 20^3 ). Asymmetric interactions may also be the res ult of heterogeneity in the sizes or 
strengths of players ( Mavnard Smith and Parker , 197fil : iHauser et al.l . l2014[) . Whether the source of asymme¬ 
try is the environment or the players themselves, our model effectively resolves a collection of microscopically 
asymmetric interactions with a macroscopically symmetric game in the limit of weak selection. Figs. [T]and 
[2] illustrate this result for three common update rules. 

Sim ilar forms of asymmetry have been studied previously in evolutionary game theory: Szolnoki and Szabdl 
( 2007ll consider asymmetry appearing in the update rule that results in “attractive” and “repulsive” players in 
the pairwise comparison process. For games wi th population structures defined by two graphs (“interaction” 
and “dispersal” graphs'), lohtsuki et al. ( 2007al f9i show that the evolution of cooperation can be in hibited by 
asymmetry arising from differences in these two graphs. On the other hand, Pacheco et al.l (l2009l) show that 
heterogeneous population structures can promote the evolution of cooperation by effectively transforming 
a collection of microscopic social dilemmas into a global coordination game. This result is reminiscent 
of our Theorem [U which relates the microscopic interactions to the global behavior of a process. Such 
heterogeneo us population structures can result in asymmetric interactions even if the underlying game is 
symmetric ( Macieiewski et aP . l2014ll . These models, although somewhat different from ours, demonstrate 
that asymmetry (in its many forms) has a remarkable effect on evolutionary dynamics. 

Although genotypic asymmetry can always be reduced to a (larger) symmetric game under genetic update 
rules, this symmetric game can be of independent interest. For example, Eq. (HU) shows that if cooperators 
vary in size or strength, then certain cooperators may increase in the Donation Game even un der birth-death 
updat ing. In contrast, cooperation never increases in the absence of cooperator variation lOhtsuki et al. 
( 2006ll . Though defectors still eventually outcompete cooperators, the transient increase in cooperators 


suggests that other evolutionary processes with this form of asymmetry can behave in novel ways. 
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If both ecological and genotypic asymmetries are present, they can be handled separately: genotypic 
asymmetry is reduced to either (i) ecological asymmetry (if the update rule is cultural) or (ii) a symmetric 
game with more strategies (if the update rule is genetic). In either case, an evolutionary game with both 
ecological and genotypic asymmetries can be reduced to a game with ecological asymmetry only and hence 
Theorem [T] applies. Our framework handles asymmetry resulting from varying baseline traits due to both 
environment and genotype, which could be referred to as phenotypic asymmetry. 

The presence of ecological or genotypic asymmetry in an evolutionary process does not necessarily depend 
on the selection strength or update rule; these forms of asymmetry may be incorporated into many evolu¬ 
tionary processes. Theorem [U which effectively reduces a game with ecological asymmetry to a particular 
symmetric game, is stated for four common update rules in evolutionary game theory. Fig. [3] demonstrates 
(using the asymmetric Snowdrift Game) that this theorem is specific to weak selection. That selection is 
weak is often a reasonable assumption when using evolutionary games to study populations of organisms 
with many traits. However, our study of the asymmetric Snowdrift Game for stronger selection strengths 
suggests that the behavior of asymmetric games is more complicated if selection is strong. Though more 
difficult to treat analytically, symmetric games under strong selection are worthy of further investigation. 

Asymmetry is omnipresent in nature, and any framework that is used to model evolution should take into 
account possible sources of asymmetry. We have formally introduced ecological and genotypic asymmetries 
into evolutionary game theory and have studied these asymmetries in the limit of weak selection. Asymmetry 
has a natural place in the Donation Game and the Snowdrift Game, but our results are applicable to any 
general n-strategy matrix game. Our treatment of asymmetry highlights important differences between 
models of cultural and genetic evolution that are not apparent in the traditional setting of symmetric games. 
Ecological and genotypic asymmetries cover a wide variety of background variation observed in biological 
populations, and, as such, our framework enhances the modeling capacity of evolutionary games. 


4. Methods 


For the two genetic processes (death-birth and birth-death) and the two cultural processes (imitation 
and pairwise comparison) we consider, we treat ecologically asymmet ric games on a large, regular network 


using pair approximation ( Matsuda et al.l . 1992 : Ohtsuki et ah . l200dl . We assume here that the degree of 


the network, k, is at least 3. For fc = 2, the network is just a cycle, and we do not treat this case here. The 
detailed steps of each calculation are omitted but we include the main setups to allow for reconstruction 
of the reported resu l ts. W e begin by recalling the way in which these four processes are defined (see eg. 
lOhtsuki and Nowak ( 2006l l'l: 


(DB) In the death-birth process, a player is selected uniformly at random from the population for death. 
A neighbor of the focal individual is then selected to reproduce with probability proportional to 
relative fitness, and the resulting offspring replaces the deceased player; 

(BD) In the birth-death process, an individual is selected from the population for reproduction with 
probability proportional to relative fitness, and the offspring replaces a neighbor at random; 

(IM) In the imitation process, an individual is chosen uniformly at random to evaluate his or her strategy. 
This focal individual either adopts a strategy of a neighbor (with probability proportional to that 
neighbor’s relative fitness) or retains his or her original strategy (with probability proportional to 
own relative fitness); 

(PG) In the pairwise comparison process, a focal individual is selected uniformly at random from the 
population to evaluate his or her strategy. A model individual is then chosen uniformly at random 
from the neighbors of the focal individual as a basis for comparison, and the focal player adopts the 
strategy of the model player with probability proportional to the model player’s relative fitness. 


4.1. Notation and general remarks. Let § = {Ai ,..., An} be the set of pure strategies available to each 
player and suppose that there are N players on a regular network of size N (i.e. every node is occupied). 
A strategy pair (A,., A^,) means a choice of a player using strategy Ar who has as a neighbor a player using 
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strategy Ag. Let 


Pr 

Prs 

Qs\r 


= frequency of players using strategy Ar; 

= frequency of strategy pairs {Ar^Ag)', 

= conditional probability of finding an s player next to an r player. 


We will make repeated use of the following properties of these quantities: 

n n 

'^Pr = '^Qslr = 1 ; 


r—1 




(17a) 
(17b) 
(17c) 

(18a) 

PsQrls = Prs = Psr = Pr<?s|r- (18b) 

Strictly speaking, the equalities Ps<?r|s = Prs = Psr = Pr9s|r need not hold in general. As a pathological 
example, one may consider the network with two nodes and a single undirected link between these nodes. 
If the player on the first node uses A^, the player on the second node uses A,.,, and r A s, then prs = 1 but 
Ps = 1/2, which gives qr\s = 2. However, for large random regular graphs ( Bolloba j . 200 ill , condition (I18bl) 
holds approximately, and we will take this equality as given in what follows. 

For X G s<n’ E [AX] denote the expected change in X in one step of the process. 

A pair {A^A) denotes a player on vertex i using strategy A^. Given pairs {Ar,i) and (Ag,/), we denote 
by TTfAsj) (^rA) the expected payoff to a player at vertex j playing strategy Ag given that they have as a 
neighbor an individual playing strategy A^ at vertex i. If /3 ^ 0 is a parameter representing the intensity of 
selection, then payoff, tt, is converted to fitness, fp (tt), via 


/^(tt) := exp|/37r|. 


(19) 


When defined in this way, fitness is always positive. 
The main theorem we prove is the following: 


Theorem [TJ In the limit of weak selection, the dynamics of the ecologically asymmetric death-birth, birth- 
death, imitation, and pairwise comparison processes on a large, regular network may be approximated by 
the dynamics of a symmetric game with the same update rule and payoff matrix M := iCijM®-!, 

i.e. 



Ai 

A 2 

' An 

Ai 

^ 011,011 

^12,^21 

■ din 5 dnl 

_ A 2 

021,012 

(^22,0^22 

d2n 5 dn2 

M = 




An 

^ (Jnl : 0>ln 

0>2n 

■ dnn 1 dnn J 


where Ust := each s and t. 

Theorem [T] is established for each of these four update rules separately: 


( 20 ) 


4.2. Death-birth updating. If an individual is playing strategy Ar at node i, Ag at j, and if Wij ^ 0, then 


n 

{Ar, i) = a/; -f ^ Wjm X] O-iT <lt\s- 
m^i t—1 


( 21 ) 


Suppose that an (Aj.,i) individual is selected for death. The probability that {Ag,j) replaces this focal 
individual is proportional to fp {n(^As,j) {Ar,i))- For each i, let (H, ... ,ik) be an enumeration of the indices 
j with Wij 7 ^ 0 (say, in increasing order) and let si be the strategy used by the player at vertex ii. If (A,., i) 
is chosen for death, then the probability that it is replaced by (Ag^, ig) is 



( 22 ) 
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The Taylor expansion of this term for small f3 is 


//3 


E =1 U 


>* 3 ) 


(^r j *) 


■/3 


/ kT^(AsM) i^r, i) - Ej=l i^r, i) ' 


/c2 


+ O (/?"). (23) 


This expansion will be used frequently in the displays that follow. 


4.2.1. Approximation of the expected change in strategy frequencies. Let 5x,y be the Kronecker delta (defined 
to be 1 if X = y and 0 otherwise). The probability of choosing the player on vertex i for death is 1/A^. The 
chance that this player is using strategy Ah is pt- Suppose that , ■ • •, As^^ ^ is a fc-tuple of strategies. If 
the focal player at vertex i uses strategy Ah, then the probability that the player on vertex ii uses strategy 
for each ^ = 1,..., fc is |^ • • • qs^^\h- Thus, 


N 




\h' '' Qs 




i—l h^r 


e=i 


fg (f^(Ar,ie) i^hji)) 


yEUfh 


{Ah,i] 


N 


( 


N 


y~! \r‘'- Qsi,_\r^si,p, 


i —1 Sj, —1 


h^r^—1 


fp iA{Ah,it) i^r, i)) 


\ 




N 


(24) 


for each strategy, Ar- The Taylor expansion to first-order yields 


where 


E [Apr] ^ /3 ( (A) - (B) - (C) + (D)) + O {(3^) , (25) 


N k n 


Y ^^h\’'^(as. ,iA 

h^r i=l£=lsi^=l y 'e £ 

{Ar^ i) ; 

(26a) 

N k n 



{^)^Y^h\rYY Y <l-H\h^(A,, 

h^r i=l£=lSi^=l ^ ' 

1 {Ahj i) ; 

(26b) 

N k 



(C) = qh\r 'Y^ ’^i^hPe) (Ar, *) ! 


(26c) 

h^r i=l £=1 



N k 



(D) = ^ qh\r Y Y {^h, i) ■ 


(26d) 


h^r i—l £—1 
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4.2.2. Approximation of the expected change in pair frequencies. If r ^ s, then 


E [Aprs] 
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~ ^2 9si^\h ■ ■ ■ dsi^lh 

i—lh^r,s =1 

//3 iAh,i)) 


J2s. 
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^ X]q:= 1 ,s 
kN 


N 


]\ q '^2 ^2 P ^ ^2 Isij^lh ■ ■ ■ Qsi^\h 
i=lh^r,s Si.^,...,Si^=l 

/ 

//3 {T^{A^,n) {Ah,i)) 


J2s. 

e=i 


EUfh 


'j {^h,i)j J 


2y , 6s T 
^ ^Oc—1 ’^^Q 

kN 


1 

N 


N 


y~! Pr ^2 ^®n I*" " ' I*" 

i=l Sij^,...,Sij,=l 

//3 ('^(Asjif) (^rj*)) 
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N 


'^Pr '22 (IsiAr ■ ■ ■ (Isi 
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h^r,s e=l 
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On the other hand, 


E[Ap,,] = ^ qs,,\h---qs,jh 

i=l h^r Sij ,...,Sif_=l 

( 




fp {'^{Ar.u) i^h,i)) 


y^j=i U 


(^=ij .*j) 


{_-^h 1 0 


kN 


- n n 

T. 


N ^ qsi^\T ■ ■ ■ qsijT 

i—l Si^,...,Si^—l 


( 


h^r1—1 


fp {’^(AhPe) (^r> *)) 


= l I ^(A., 


{Ar,i) 


^Sa=l ^Si^,r 

kN 


(28) 


The zeroth-order Taylor expansion yields 


E [Aprs] ~ ( -kq,\r + (fc - 1) ^ qs\hqh\T 1 + O (^) 


kN 


h^l 


(29) 


if r 7 ^ s, and 


E [Aprr] + (^ “ 1) X! 9r|/ig/t|r^ + O (/3) . 


(30) 


Therefore, E [Apr] = O (13) (by Eq. (HH)) and E [Aprs] = 0(1) (by Eqs. (P^)) and (1501) 1 for each r and s, 
which results in a separation of timescales between the strategy frequencies and the pair frequencies. In 
particular, the pair frequencies will reach their equilibrium much more quickly than the strategy frequencies 
will, so we can examine t he expression for E [Apr] under the assumption that the pair frequencies have 
reached their equilibrium ( Ohtsuki et al. . 2006ll . 


4.2.3. Weak-selection dynamics. Assuming that each update takes place in one unit of time, we can ap- 
pr oximate the dynamics by the determinist i c syst ems p^ = E [Ap^j and p^s = E [Ap^s] for each r and 


I Ohtsuki et al. . 2006t Ohtsuki and Nowakl 2006ll . Since f3 is small, we see that the latter system will 


reach equilibrium much quicker than the former. When the pair frequencies have reached equilibrium (i.e. 
E [Aprs] = 0), we have 


n 

^9s|r “ ^s,r {k 1) ^ ^ Qs\hQh\r- 

h^l 


(31) 


Ohtsuki and Nowakl (|2006[) show that this equation implies that 


Qr\s Vr H“ 



(32) 
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Assuming the system has reached this local equilibrium, we then have 


N n 


E [Apr] (A: + 1) ^ ^ aliq^ir 

N n 

- fc y] w^j al{qt\sqs\r - Y °‘st9s\tqt\r ] + O (/3^) 

i,j — l s,f—1 «,i—1 s,i—1 / 

/{k — l)p \ f ^ ^ ^ \ 

“ /^ f ^ ^ 0,rsQs\r ^ ^ ^ ^stQt\sQs\r ^ ^ 1 ^ ('^ ) 

= P ^ - 2) (fc + 1) ^ astPsPt + (fc^ - fc - 1) y] 

n n \ 

- y] - (fc + 1) y] OssPs + (fc + 1) a,.r I + O (/3^) 


(33) 


as long as /3 is small. Therefore, if we choose an appropriate time scale and set 


Pr 

brs 

(t> 


E [Apr] 
At ’ 


O^rr “ 1 “ Clrs O^sr ^ss 

k-2 


^ ^ PsPt^St') 
s,t—l 


(34a) 

(34b) 

(34c) 


then Pr = Pr (X)r=i Ps i^rs + ^rs) — ip )) recovering the replicator equation of lOhtsuki and Nowak ( 2006fl . It 
follows that the dynamics depend on M, proving Theorem [T] for death-birth updating. 


4.3. Birth-death updating. In the birth-death process, an individual is selected for reproduction with 
probability proportional to relative fitness. The offspring of the selected player then replaces a random 
neighbor. Rather than trying to approximate the total fitness of the population, we will simply denote this 
value by /p°p. Since this value is positive, it does not influence the sign of the expectation values and as 
such we will largely ignore it. We have 


^[^Pr] = J^^Pr 


N 


N 


+ 


E E 

i—l Si^ 

1. N 


Qsi^ |r • ■ • 9sij, I' 


■* i;<, E 




h^r 


fpop 


h^r 




Qsi^ |/i' *' Qsif, 


2=1 Si^ 




Z), = l ^Si. ,h 


Z)j = l ^Si. ,r 


-N ■ 


The local equilibrium conditions for birth-death updating turn out to be the same as those for death-birth 
updating (Eq. (15^ 1. These local equilibrium conditions do not take into account selection as long as /? is 
close to 0, so they are essentially based on a neutral process in which at most one strategy is update at each 
time step. Therefore, it is perhaps not surprising that these conditions are the same for different processes 
based on one strategy update in each time step. 
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In the following expressions, by a; oc j/ we mean that x is proportional to y with positive constant of 
proportionality. Letting j3 ^ Q and using the local equilibrium conditions (as well as the same separation- 
of-timescales argument we used in M.2.3|) . we find that 


N n N n N n 

E [Apr] oc I fc ^ Wij ^ aj-igsir - - 1) X! X! “ X! X! 

i,j—l s=l s,t—l s=l 


0{/3^) 


OC Ppr ( k E (^rsQslr l) ^ ^ ^ ^ ^srQs\r 1 ^ ) 

\ s—1 s,t—l s—1 / 


( n n n n \ 

- {k -2) ^ astPsPt + {k - 1)'^ arsPs - ^ asrPs - ^ assPs + Orr j + O (/3^) . (36) 

S,t — 1 S—1 S—1 S — 1 / 

Just as we saw with the death-birth process, after choosing an appropriate time scale and letting 

- _ {k + l)arr + arB — ttsr - {k + l)ass 

{k-2) (fc+1) 

n 

s,t=l 


(37a) 

(37b) 


we have pr = Pr (X]r=i P® ip-rs + brs) — 0), proving Theorem [T] for birth-death updating. 


4.4. Imitation updating. In the imitation process, an individual is selected uniformly at random from 
the population to evaluate his strategy. The chosen player then compares his htness with the fitness of 
each neighbor and either adopts a new strategy or retains his or her current strategy (with probability 
proportional to relative fitness). Suppose that an individual at vertex i, playing Ar, is selected to evaluate 
his or her strategy. If s ^ r, then the probability that he or she adopts strategy s is 


'l2i=l^se,sfp i^r,i)j 

Sk. * '))+* (Sk. “k,) 

and the probability that his strategy remains unchanged is 



fp\ 


) +//3 (Ej=l«r'4) 

e4i 1 


+ fp(EU^%) 


(38) 


(39) 


We let {Ar,i) be the same as it was for death-birth updating. For small /3, 

+ //3 ( S '=1 “"4-) 


k + 1 


{k + iy 


+ O (/32) . (40) 
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4.4.1. Approximation of the expected change in strategy frequencies. For r G {1,..., n}, 
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(41) 


The local equilibrium conditions are exactly the same as they were for the death-birth process. Assuming 
that the system has reached this local equilibrium, the separation-of-timescales argument we used in il4.2.3l 
gives 


E [Apr] ~ /3 
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{k + iyN^ 


= /3 


kpr 


{k + iyN 
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n n \ 
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- 3 ^ asrPs - (fc + 3) ^ assPs -f (fc -|- 3) a^r ] +0 (/3^) . 


(42) 


With hrs = ^^+^)°''"+(X 2 )(fc+ 3 ) and (j) = Yys,t=iPsPtast, we have 


— Pr I ^ ^ Ps (^rs 4“ ^rs) ' 


\s=l 


(43) 


which establishes Theorem [T] for imitation updating. 


4.5. Pairwise comparison updating. In the pairwise comparison process, a focal individual is selected 
uniformly at random from the population. A model individual is then chosen uniformly at random from 
the neighbors of the focal individual. If TTf and ir^ denote the payoffs to the focal and model individuals. 
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respectively, then the focal player will adopt the strategy of the model player with probability 

1 _ //3 (TTm) 


(44) 


1 + fp (tt^) + fp (ttj) ’ 

where /3 ^ 0 is a real parameter representing the intensity of selection. In addition to the expected payoff 
(defined in the same way as for death-birth updating), we let 

k 

(45) 

i=i 

if (As, i) has as a neighborhood , ■ • ■, ■ With this notation in place, we have 

^ n 

E[Ap,] = — Qs,,\h---qs,jh 


X 


N 


1 

i: 


i=l =1 

k ^ I ^ 

Ss..,h 


xEE 

h^r £—1 


fp (HArPt) iAh,i)) + fp {'n-{A^,i)) ) 

Qsi^ I’" * ' ’ 1^ 

fP {Ah ,ii) Ar T i)) \ 


fp (T^iAh.H) Ar,i)) + fp {T^iArA I \ N 


As ,5 —>• 0, we have 


fp (a^) 


1 


fp (x) + fp (y) 2 

Consequently, in the limit of weak selection, 

N n N 

Pr 


P 


x-y 
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(47) 


E[Apr]^P 
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n N n 
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= p 


S = 1 
(fc - 2)pr 

2{k-l)N 


S,t — 1 


S = 1 


- (fc - 2) ^ astPsPt + (/c - 1) ^ 


^rsPs 


s=l 


(48) 


'y ) ^srPs y ) ^ssPs ~k Ojrr 1 4 ” ^ (/^ ) • 

S=1 S=1 / 

The local equilibrium conditions are exactly the same as they were for the other processes, but in this 
case they are not needed to arrive at this last expression for E [Ap^]■ With 5rs = arr+a^s-aar-ass 


fc -2 


(p = Yfllt=iPsPt^st, we have pr = Pr (urs + Ws) —<(')• It follows that the dynamics of the pairwise 

comparison process depend on M, which completes the proof of Theorem [T] 

Finally, we show that the dynamics of each process are independent of the particular network configuration 
if the asymmetric game is spatially additive: 


Definition [Jl If apg = x].g + for each r and s, then M*-! is called a spatially additive payoff matrix. If 
M*4 is spatially additive for each i and j, then the game is said to be spatially additive. 

Corollary [TJ If M®-! is spatially additive for each i and j, then the expected change in the frequency of 
strategy A^, E[Apj.], is independent of (u^ij)i<i j<jv each r. In particular, the dynamics of the process 
do not depend on the particular network configuration. 
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(49) 


Proof. If a(4 = X® g + for each r, s, i, j, then 


= — y 

hN ^ 


N 


ast 


kN ^ N 

i,j—l i—1 


N N 

= NT.<^ + NT.yrs^ 


i=i 


which is independent of (w^ ) 




. The corollary then follows directly from Theorem [TJ 


□ 


4.6. Computer simulations. In each simulation, a random fc-regular network (with k = 3) oi N = 500 
vertices is generated. The selection intensity is /3 = 0.01 for Figs. [T]and[21 /3 = 0.1 for Fig. [3KA), and /3 = 0.5 
for Fig. [nKB). The figures are generated based on data collected from a number of cycles: In each cycle, the 
network is given an initial configuration of cooperators by first choosing a density, d, uniformly at random 
from the interval [0,1], and then placing a cooperator (resp. defector) at each vertex with probability d 
(resp. I — d). The update rule is applied until either C or D fixates. (The absorption time depends on a 
number of factors including the game, selection strength, and initial configuration of the population.) Let 
Pc (t) denote the frequency of cooperators at time t; pc (0) is just the initial frequency of cooperators. The 
frequency pc (t + 1) is obtained from pc (t) by adding to it the change in the frequency of cooperators over 
the next N (= 500) updates. For each t, the quantity pc (t + 1) — pc {t) is associated with pc {t). Once 
PC S {0,1}, a new initial configuration of cooperators is chosen and the process is repeated. After each 
possible value ofpc has at least 10® associated data points (changes in cooperator frequency), these changes 
are averaged, and this resulting quantity, Apc, is paired with the corresponding value of pc- These pairs 
are then plotted to obtain Figs. IH |2 and |3l The results from pair approximation apply to the expected 
change over one update, but we can easily get a predicted result over N updates (i.e. one Monte Carlo step) 
by scaling the expressions for E [Apc] by a factor of N. 

Small deviations from the expected results are seen in each of the figures, and these deviations are due 
to the effects of finite selection parameter (/3) and the finiteness of the set of possible values of pc {^Pc is 
a multiple of l/N). As an example of how these properties can give rise to small deviations, consider the 
Donation Game under imitation updating in Fig. HA). Eq. (1421) predicts that E [Apc] is always positive, 
yet we observe in Fig. UKA) that this change becomes negative as pc 0,1. If Pc = {^ — 1) and /3 > 0, 
then the only defector in the population has a higher payoff than all of the other cooperators. Let denote 
the fitness of the player at location j. Thus, with just a single defector (at location i) in a population of 
cooperators, we have ^ ^ for each j ^ i, with equality if and only if /3 = 0. The expected change in 

the frequency of cooperators in the next time step is 


E [Apc] 




h 


if+11 


{o 


7=1} 




(50) 


The first (resp. second) summation runs over all of the neighbors of i (resp. j). For each j ^ i. 


Ad 

_ i£ _ 

f(0 I fU) 

Jp 2^ {j : Wij=l} Jp 
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_ ii _ 

fU) I Ai) 

Jp ^ 2^{l : Wji=l} jp 
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I 
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both with equality if and only if ,5 = 0. Therefore, we see that 


( 4 ) 






(51a) 

(51b) 


(52) 


with equality if and only if /3 = 0. The same argument explains the negative average changes as pc —>■ 0. 
Since pc can only take on finitely many values for a given population size, similar arguments explain the 
small discrepancies between the actual and expected results for intermediate values of pc (see Fig. [1]). 
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